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COMMENT  ON  “CORRECTED  DIFFUSION  APPROXIMATIONS 
IN  CERTAIN  RANDOM  WALK  PROBLEMS” 


Michael  L.  Hogan 
Columbia  University 


Abstract 


Correction  terms  for  the  diffusion  approximation  to  the  maximum  and  ruin 
probabilities  for  a  random  walk  with  small  negative  drift,  obtained  by  Siegmund 
[1079]  in  the  exponential  family  case,  are  extended  by  different  methods  to  some 
nonexponential  family  cases. 


Key  Words:  Diffusion  Approximation,  Heavy  Traffic,  Random  Walk,  Gam¬ 
bler’s  Ruin. 
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This  paper  is  concerned  with  extensions  to  the  nonexponential  family  case 
of  two  problems  considered  in  Siuguiuud  [10T0].  The  first  problem  b  to  find  the 
expected  value  of  the  maximum  of  a  random  walk  with  small,  negative  drift,  and 
the  second  b  to  find  the  dbtribution  of  the  same  quantity .^-Siegmund’s  result 
in  the  first  case  b  the  following  (Theorem  1  of  [6]):  ConsideTan 'exponential 

family  Pg,  #  €  a  neighborhood  of  0,  so  that  under  Pg,  . . are  independent 

with  density  relative  to  a  nonarithmetic  dbtribution  F.  Assume  that 

the  problem  b  normalized  so  that  E^x\)  —  i^(0)  —  0,  Varo(*i)  —  i>ff(0)  =  l.  Let 
5n  —  E"  *i»  ffc  —  inf(n :  Sn  >  *},  r+  —  »d,  and  M  —  supn{5n},  M  <  oo  Pg  -a.e. 
if  t  <  0.  Then,  Siegmund  shows  that  as  #  1 0, 


EgM  —  — - 


Bps?. 

2EqSta 


+  0(A), 


where  A  «*  -  #,  and  #j  >  0  b  such  that  iiti)  *  iit).  In  fact,  he  can  calculate 

the  0(A)  term,  a  feature  that  will  not  carry  over  to  the  nonexponential  family 
case.  In  the  second  case  the  dbtribution  of  the  maximum  b  given  by  considering 
such  probabilities  as  Pg{rg  <  oo}  —  Pg{M  >  *}.  The  appropriate  normalization 
in  the  exponential  family  case  b  to  take  k  —  in  which  case  Siegmund  showed 
that  as  #  1 0 


»}  ■■  e"2^  1  —  A 

i 


ES?+ 


+  o(A) 


The  first  of  the  two  problems  has  recently  been  considered  by  Klass  [1083], 
who  considers  a  translation  family  and  computes  the  expected  value  of  the  max¬ 
imum  when  the  drift  b  small  and  negative  up  to  terms  that  are  o(l)  as  the  drift 
approaches  0,  under  the  condition  that  the  underlying  random  walk  has  third 
moments,  which  b  certainly  a  minimal  condition.  The  problem  with  Klass’  cor¬ 
rection  term  b  that  it  does  not  resemble  Siegmund’s  correction  term.  Even  in 
the  case  of  the  normal  dbtribution,  to  which  both  theorems  apply,  the  equality 
of  the  two  correction  terms  b  not  apparent. 


A  *.  \  . 


.VwKVV  - 


Here,  the  random  walks  will  also  be  assumed  to  belong  to  a  translation  family, 
i.e.,  P0{X1  €  A)  —  P0{Xi -#  €  A),  where  —  0,  Eo*f  —  1,  and  EoP^f  l<  «>• 

This  b  not  necessary,  but  b  the  easiest  framework,  next  to  exponential  families 
that  incorporates  the  appropriate  continuity  in  dbtribution.  The  maximum  will 
again  be  denoted  by  M  — 1  sup  (5,;  i  >  0},  which  b  almost  surely  finite  provided 
9  <  0.  It  will  be  shown  that 


T  + 


-1  £bS2r_ 


2EqSt- 


+  o(l), 


which  b  the  result  of  Siegmund  in  the  form  he  gave  it,  modulo  a  different 
parametri-  zation.  He  used  the  parameter  A  «■»  -9,  where  9  <  0  b  the  canoni¬ 

cal  parameter  of  the  exponential  family,  and  #j  b  such  that  ^(*i)  ”  iA9).  It  b  not 
hard  to  show  that  with  ^0)  «=■  ^(0)  «=  0,  and  ^*(0)  “  1,  ^  -  2e]xJ  +  3  +  °(1)’ 

7  —  EqXj  ,  and  from  the  Wiener-Hopf  factorization 


B&h  So*?-  y 

2f*>Sr+  SffeSr- ”V 


Using  these  two  relations,  it  b  easy  to  establbh  the  equivalence  of  Theorems  I 
and  2  with  the  corresponding  results  of  Siegmund. 


The  dbtribution  of  the  maximum  b  determined  by  the  quantities 
Pf{tl  <  00}.  To  get  a  diffusion  limit  one  assumes  that  0  >  9  -*•  0,  and  9b  -* 
and  the  relation  b  —  m1/2,  9  -»  (  >  0,  m  a  large  integer  has  been  chosen. 

Thb  seems  a  bit  peculiar  here,  but  it  b  the  usual  way  of  normalizing  a  random 
walk  to  get  a  diffusion  limit,  and,  in  fact,  the  first  term  in  the  dbtribution  b 
essentially  given  by  the  invariance  principle.  The  result  in  thb  case  b  given  by 
Theorem  2,  and  it  basically  depends  on  Lemma  1,  but  some  technical  conditions 
beyond  those  required  by  Lemma  1  have  been  imposed  to  facilitate  a  Fourier 
inversion.  These  conditions  are,  doubtless,  not  minimal. 


5555 


In  addition  to  the  notation  introduced  above,  for  9  <  0,  let 


r_  —  inf{n  :  Sn  <  0}, 

X+(X)-E,{«‘>5'+;i-+<oo) 

*(X)  -  EeciXXK 

Of  course,  some  of  these  quantities  depend  on  #,  but  that  dependence  will  be 
suppressed. 

Lemma  1. 

1  9ErAS}  1 

Ee(Sr+;  r+  <  oo)E,(Sr_)  -  -  -  +  +  o(0) 


as  0  >  9  —  0,  provided  £bP^ll3<  °°- 

Proof.  From  the  Wiener-Hopf  factorization  (cf.  Feller  [1071],  p.  605) 

1-*X)-(1-X_(X)X1-X+(X)). 

In  particular 

*'(0)-Xi(0Xl-X+(0)) 

-Xl(0)P,{r+-oo}. 

Consequently, 

1-<KX)~(1- X_(X))P, {r+  -  oo}  -  (1  - X_(X)XX+(0) - X+(X)), 


1  -  *(X)  +  XXL(0)P#{r+  -  oo}  - (1  -  X_(X)  +  XXL(0))P#{r+  -  oo} 
«(l-X_(X)XX+(0)-X+(X)). 


The  condition  E$\X\\3<  oo  guarantees  that  Eg(S?_)  <  E£st+\  r+  <  oo)  <  oo, 
so  dividing  by  X2,  and  letting  X  -*  0  produces 

_^  +  ^(0)^{r+  _  ^  _  _Ef{sr_)Ee(ST+;  r+  <  oo) 

or,  using 


P,( r+  -  oo)  -  £<{r  )  ” 
(Woodroofe  [1082],  Sec.2.3) 


~£*(Sf_)Ef(Sr+;  r+  <  oo) 


--(*<><*?>- 


£,.5r_  j 

Wr.)J  * 


W_)  . 


Now,  is  a  continuous  function  of  #  (see  proof  of  Theorem  2,  Chapter  5, 

Hogan  [1084]),  in  spite  of  the  fact  that  numerator  and  denominator  separately 
need  not  be.  This  observation  establishes  the  lemma. 

Theorem  1.  Suppose  oo.  Then  as  0  >  #  -» 0 


EtM - 


1  Eq  S2 

h+ik£+«"- 


Proof.  It  is  easy  to  see  that  M  can  be  represented  as  a  randomly  stopped 
random  walk,  A/£  Zjy,  where,  under  Pg,  Z\  £  ST+  |  r+  <  oo,  and  N  is  a  geometric 
random  variable  with  success  probability  Pg{r+  <  oo}  completely  independent 


of  the  random  walk.  Hence 


E9M 


E6NEe(ST+  |  r+  <  oc) 
E$(Sf+;  r+  <  oo) 

Pe{r+  —  00} 

Ee{Sr+]  r+  <  oo)E*{r_} 

E$(Sr+;  r+  <  00 )E${St-)'i 


<5bH 


by  Lemma  1.  I 

The  increasing  ladder  times  of  a  random  walk  S,-  are  the  times 


r(0) 


“  0, 


r^1)  ■=  inf{n  :  Sn  >  0}, 

r(n+l)  =  |inf{n  >  r(n) :  Sn  >  Sr(B),}>  <  00 

loo,  r*”)  —  00  • 

The  increasing  ladder  process  is  the  process 

Z0  =  0 

Zi  ~  SrWV'Ucc)’  *>0- 
Lemma  3.  Let  S,-  be  a  random  walk  with  ES\  <  0.  Then 
P{Si  <  a  V.}  -  F(o)  P{Si  <  0  V.}, 

a 


where  F(a)  =  EJLo  —  a>  <  °°}  aQd  %i  is  the  increasing  ladder  process 
of  5,. 

Proof.  This  is  Lemma  8  of  Spitzer  [1057]  when  the  distribution  of  X ,•  is 
absolutely  continuous  and  is  equivalent  to  12.2.7  of  Feller  [1071]  in  the  general 
case. 

Theorem  2.  Suppose  X,-  are  i.i.d.  random  variables  satisfying  EqX ,■  «= 
0,  EqX^  —  l,£bpfi|s<  oo,  and  Pg  are  such  that  Pg{X;  €  >1}  *=*  PoP^i  ~  #  6 
A).  Suppose  further  that  3fp  <  0  such  that  V  #  €  (#o,0],  5r+  l{r+<eej  has  an 
absolutely  continuous  distribution  under  Pg  and  satisfies 
Condition  0:  The  densities  ^P^{Sr+  <  x)  are  a  bounded  subset  of  Lx(Jt)  for 
some  X  >  1.  Then 

P-,^1,  <  oo)  -  (l  +  ^  +  •<*> 

as  1 1 0. 


Proof.  Many  quantities  will  implicitly  depend  on  the  parameter.  Let 

P  —  <  «>} 

Pi  -  £-#(#♦  l»*  <  °o) 

<°°). 

Consider  first  the  quantity  <  £>  r(n)  <  oo},  where  Zn  is  the 

increasing  ladder  process  for  S,-,  and  the  are  the  increasing  ladder  times.  As 
in  the  Fourier-analytic  proof  of  the  Renewal  Theorem  (see  e.g.  Breiman  [1068]) 
it  is  easy  to  show  that 


00 


#■>0 


}-Ij 

(  <»  tin  ft /# 

'  rJ 

-00  * 

-ij 

f  oo  sin  fl/| 

n) 

'-00  * 

1 

f  oo  sin  (t/0 

JT  J 

—00  t 

Re 


PM 

G  -pm)dt 

(l-pjTi(Q)rft 

0~p/i(0)2  +  (p/2(0)2 


where  /(<)  —  /i(<)  +  •/2(<)>  /i»  /2  real-  Making  the  change  of  variable  £  —  z  and 
multiplying  and  dividing  by  1  -  p  brings  this  into  the  form 


If  06  sinC*  (I-pACzJXI-p) 
kJ  -ooz(l-p)(i-p  fx(tt))2  +  (/2(^))2  a2> 


and  so  by  Lemma  2 
/^{ra  —  00} 


—  1  f  00  sin  £z 

iz 

xj  —00  2 

1-P /»(**)  .  \ph(6z)? 

y-p  +(i-pHi-p/1(#2)) 

_  1  f  00  sin  ( 2 

f  1  \ 

x  J  —00  z 

unp.r 

1  /«>  sin^l 

r 

1 

xJ-00  z  I 

.  (p  /*i#2))2 

\ 

ri-p  +(w)(i-p7i(^)) 

(1) 


I  dz 


where  vv  *  E_g(ST^)E^g(ST+;  r+  <  00).  By  Lemma  1,  vp  is  known  up  to  terms 
which  are  0(1  -  p),  and  therefore  the  first  integral  is  known  up  to  terms  of  the 
same  order.  It  is  necessary  to  analyze  ^  X  second  integral.  For  this,  it  is 

convenient  to  break  the  integral  up  into  /$T  +  /|,|>(p„  where  ( ,  -«*  >  0  will 
be  specified  later.  The  conditions  of  the  theorem  guarantee  that  /j  and  f2  have 
expansions  of  the  form 


/l  —  l-~%0(*4) 

S\  -p?*2  +  0(z<) 

where  0(2*)  holds  uniformly.  Using  the  fact  that  ^  is  bounded  above  and  away 
from  0  it  is  easy  to  see  that 


1  -f>/l(#*) 

1-p 

/?(**) 

(1-pX1-p/i(#z)) 


l-P^—ht  +  O^z4) 

P?*2(l^p)2  +  °(t2z4) 


p2/2(**)  VP *2  +  °if2*4) 

(1  -  PXl  -  P  fi(9*))  ™  1  -P^iO^I*2  +  0(fiz4) 

-  (i %z2  +  0(#2*4))(l+p^r^#z2  +  0(f2*4)) 

—  v2z2  +  P  ‘  ‘'p*2  +  0(*2*6)- 

Consequently 

»  1-P _ 1 _ 

1  -  p  f(tz)  l  +  *,2*2  -  p^ylp^l  -  v$zt)  +  0(P226) 

and 

1  f  1-p _ I_\  P?!^*^1  ~  *j*2)  +  °(**5) 

t  V  1  ~  p  /(**)  i  + 1,2 *2 J  (i  +  *,2*2X1  +  ^p*2  +  o(02*6)) 

Now,  if  a  >  the  0(#2*8)  term  in  the  denominator  is  of*2)  for  |z|<  <0°,  and 
consequently  the  denominator  is  >  const.(l  +  *4).  Therefore,  the  second  term  in 
the  numerator  contributes  to  the  integral  as 

f  it, 

J  |z|<c*<*  *  1  +  *4 

and  tz2  -»  0  as  #  -*  0,  |*|<  c#°.  Hence,  by  dominated  convergence,  this  contri¬ 
bution  -*  0. 

It  is  also  clear  that 

(1  +  ^*2)  ■  1  +  „222  +  0(|226)  “  “  96  0{z~6) 


for  some  S  >  0,  and  so 


/ 


sin  £z 


P^^pz\l-Vpzi) 


.2  ,2\ 


\z\<i$a 


-dz 


(l+^U^  +  Of^)) 

sin**P^l=p*2(l-‘'p*2) 

(1  +  t^*2)2 

,£2_*_.2„  _  ,.2r2\y-5 


/ 


-dz 


+  f 


|z|<£0*  * 

sin  *z 

ICftf*  *  (1  +  i/jMX1  +^p*2  +  O(02z6)) 


'L 


and  the  second  term  is  easily  seen  to  -♦  0.  Consequently,  using  P2  r=p  0 


Esh  2  l 
sets^  "p  “* 


If  sin  fr  f  1-p _ 1  ft  f  00  ain**z(l-(5)2)  , 

# y  J-?J < *  V1-^7(^)  l  —  VpZ^J  2  7 -oo  *  (l+(f)2)2 

where  this  last  integral  exists,  and  is  taken  as  a  principal  value.  Evaluating  shows 
this  term  to  be 


0(4* -2)e-2*. 


(2) 


Next  <  will  be  chosen  to  satisfy  cos  *<0“  =  0.  Clearly,  since  o  <  0  such  that « 
can  be  chosen  arbitrarily  small  (or  large).  Then  integrating  by  parts  shows  that 


If  sin  * z  dz  .1  f  °°  cos  *z(l  +  3  z2v%) 

tJ\z\>f60  z  1  + 1 ^z2  tJ  iOa  z2(l  +  i/$z2)2 

<  const,  ^(td-0)3 


— *  0  provided  a  <  - 
Finally,  consider 
.1  f  sin*z 

'fj 


1-p 


*)>*»£  *  l~p/(#«) 


*|-  | E(Sr.)  f 


sin  *z 


|z|>c*°  *  1 -!>/(*«) 


dz\. 


The  change  of  variable  y*=*$z  brings  the  integral  to  the  form 


sin 


dz 


|y|>£0l+or  z 


1-pW-1/ 

♦I / 


oo  sin 


t0*+«  z 
00  sin  (z/t 

($l+a  Z 

l +IL 


dz\ 


Pf(*) 

1  -Pf(z) 


With  the  choice  of  t  as  above 


'/ 


oo  «in 


t0l+a 


#  /  oo  cos  (z/0 

VJ 

<  const,  f  •  -►  0, 


Condition  O  has  two  consequences.  First,  because  under  Pg,  Sr+ljr+<0Oj  has  a 
continuous  distribution  it  is  continuous  in  distribution  as  a  function  of  #.  This  is 
easy  to  see  simply  by  considering  sample  paths.  In  particular,  given  a  sequence 


m  -  Eg.it*  Sr+;  r+  <  00}  €  (*,  0), 


it  is  possible  to  find  a  pointwise  convergent  subsequence.  Second,  by  the 
Hausdorff- Young  theorem  (Katznelson  [1076],  p.  142)  the  functions  f(y)  form 
a  bounded  subset  in  u£*{&,dy).  In  particular,  if  1  <  Xq  <  |/|x°  are  uni¬ 

formly  integrable.  In  as  much  as  any  subcollection  has  a  pointwise  convergent 
subsequence,  it  has  an  £x(9t,  dy)  convergent  subsequence,  and  so  the  f{y)  form  a 
compact  subset  of  Lx°(9t,  dy).  The  function 

«***-*' 


(*W 

is  a  compact  subset  of  £*(#,  dy)  (reminder:  /  depends  implicitly  on  $  ).  It  follows 
directly  from  the  Riemann-Lebesgue  lemma  that 


/  °°sin#  /(») 

1  v  i  —  p  /(»)  v 


o. 


For  f'p+a(eomc)dz,  note  that 

41-,  M)  *(1  - p(l  +  .>!*)) +  *  '•  €  |0’ 2,i  ’ 

where  g(z)  is  uniformly  bounded  and  continuous  in  #.  It  follows  as  above  that 

Also,  it  is  clearly  enough  to  consider 


Re 


/ 


$Pi  sin 


1  +  ip\z 


■iz 


p2(mi*)2_ 


(1  -P)-*PM1* 

—  /  sk  sin^  (1  p)  *t*  PP2^2 

J  <0,+o  *  (1  —  p)2  +  (ppi*)2 

O-pI2 


1  - 


(l-p)2  +  P2**l*2  (l-p)2  +  p2/*i*2 


and  since 


has  been  treated  it  is  enough  to  consider 


ain^T  1  . 

*  (l-p)2  +  (ppi*)2 


(1-P)# 


f 

[/  e0l+a 


(z  f  1 _  .  _ 2ppjg 

#  u2((i-p)2  +  (ppi«)2)  *((i-p)2  +  (ppi*)2)2) 


Over  the  interval  of  integration  (1  —  p)  is  much  smaller  than  z,  so  each  term  in 
the  integrand  is  <  and  the  integral  is  bounded  by 


const. 


(1  -p)-0-  J 


t6i+*  — 


const.  #2(#  3(1+a)) 


-*  0  provided  a  <  -  J.  Therefore,  the  various  conditions  placed  on  a  are  simul* 
taneously  satisfied  for  any  o  6  So,  evaluting  the  integral  in  (1)  and 

combining  that  result  with  (2)  gives 


P{ry$  —  0°}-«  "a  +  W(Al  -  2)«"2«  +  o(0). 

By  Lemma  1 


so 


i/p 


2  +  4# 


2£*Sr_) 


+  o(0) 


'’('(/>  — » -  '■’<(>  -  ' »)  -  ** + •«)  • 


The  Wiener-Hopf  factorization  shows  that 


where  -7  =  £©(Xf ).  Hence 


P{TUO  -  00}  -  r2* (l  -  ^ -  2 $$)  +  o{9), 


which  is  the  form  given  by  Siegmund  (1070],  modulo  a  different  choice  of  param¬ 
eters,  as  explained  earlier. 

Here  is  one  condition  that  guarantees  that  condition  O  is  met.  Other  condi¬ 
tions  along  this  line  can  be  formulated. 

Proposition  1.  Suppose  Xj  has  a  density  under  Pq  which  is  bounded,  and 
decreasing  on  [0, 00).  Then  condition  0  is  satisfied. 

Proof.  First  note  that  the  existence  of  a  density  for  5r+  is  trivial  as  any 
randomly  stopped  partial  sum  of  an  absolutely  continuous  random  walk  is  abso¬ 
lutely  continuous.  It  is  certainly  enough  to  show  that  the  densities  are  uniformly 
bounded  by  a  constant.  These  densities  can  be  written  down  explicitly. 


F{Sr+  >  *,  r+  <  00}  —  £  f  P{Xj  >  *  -  »}  P{Sn  €  dy,  r+  >  n) 

n’—0J 

-/°  P{Xj  >  x  —  y)H(dy) 
j  —00 


where 


H(A)  -  £  (Sn  €  A,  r+  >  n},  A  C  (-00,  0] 

B«0 

-  E  (Si  <  ° . S»-1<0,  S.€A) 

n*0 

00 

“  ^  {Sn  £  •••»  •••(  Sn  S  ^B— 1»  ^b  6  A} 

B»0 

-»  E{§  of  visits  of  weak  decreasing  ladder  process  to  .d). 


Consequently 

P{Sr+  <  x  +  h)  -  P{ST4.  <  x) 


.  f°  PiXjKx  +  h-ri-PiXiKx-y} 


H(dy) 


The  integrand  is  <  f(x-y)  except  possibly  in  a  small  neighborhood  of  the  origin 
where  it  is  still  bounded  and 

/  /(*  “  »)  H(dy)  <  /{*  +  n)  H(-n  -  1,  -n) 

<  const.  +  n)  <  oo, 

<  const.  E/(")  <  const, 
therefore,  by  dominated  convergence 

^pisr+  <  *}  —  /(*  -  V)  H(dy)  <  const. 

H  depends  on  the  parameter  p,  but  it  is  easy  to  see  that  the  statements  made 
about  H  hold  uniformly. 

The  representation  of  the  distribution  of  5r+  used  in  Proposition  I  can  also 
be  used  to  prove  a  conjecture  found  in  Klass  [1083],  remark  2.5,  which,  in  the 
notation  used  here  is  that  if  Eq{S^;  5j  >  0)  <  oo,  £q5i  —  0,  then 

hm£,(Sr+;  r+  <  oo)  -  £o(Sr+). 

Klass  observes  that  pointwise  convergence  takes  place.  The  following  bound  on 
the  distributions  imply  uniform  integrability. 

r  0  » 

P$isr+  >  n,  r+  <  oo}  —  /  P-f{Si  >  n — jf>  H(dx)  <  const.  >  n}. 

/  -oo  n 

This  stochastically  bounds  Sr+l(f+<00)  by  a  fixed  integrable  random  variable. 
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